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I. Background 



OSPAC (Optimal Synthesis Program for Automatic Control) is a digital 

conputer program written in Fortran IV, which concerns itself with the 

stationary linear quadratic Gaussian optimal control problem. This problem 

can be outlined as follows: Consider a system described by 

x (t) = A x(t) + B u (t ) + y_ w(t) 

Z (t) = C x(t) 

where 

A is an n x n plant matrix 

x(t) is an n x 1 state vector 

B is an n x p control matrix 

u(t) is a p x 1 control vector 

is an n x t disturbance matrix 
w(t) is a t x 1 disturbance vector 
^(t) is a q x 1 output vector 

C is a q x n output matrix 

Here, w(t) is a vector of linearly uncorrelated, zero mean white noise 
signals with Gaussian amplitude probability distribution functions. The 
elements of w(t) are assumed to be sample functions from n random processes 
which are each ergodic and are jointly ergodic. The covariance matrix for 
w(t) is 



E [w(t ) w T (t + t)] = F 6 (t) 
where §(t) is the unit impulse function. 

The measured quantities or sensor signals are 



z(t) = H w(t) + v(t) 



3 



where 



z(t) isauxl measurement vector 
H is a u x n measurement matrix 

v(t) is a u x 1 measurement noise vector 
The elements of v(t) are assumed to be sample functions from P random 
processes each of which are ergodic and jointly ergodic. The covariance 
matrix for v(t) is 

E [v(t) v T (t + t)] = G 6 (t ) 

The system is assumed to be completely controllable and completely 
observable. It is desired to find the control function u(t) which mini- 
mizes the quadratic scalar index of performance 

J = lim ^ J 1 [y T (t) Q y;(t) + u T (t) R u(t )] dt 

1— *oo O 

where 

Q is a q x q symmetric output cost weighting matrix and at 
least positive semidefinite 

R is a p x p symmetric control cost weighting matrix and 
positive definite 

The solution to the linear quadratic Gaussian control problem can be out- 
lined as follows: 

a. ) The optimization problem can, by the called Separation Theorem, 
be broken up into two separate problems, an optimal control problem and 
an optimal estimation or filtering problem. 

b. ) The optimal estimation or filtering problem generates an optimal 

A 

estimate, x(t) of the state x(t). This estimate is optimal in the sense that 



is minimized., where 3c(t) is the estimation error defined as 



x(t) = x(t) - x(t) 

The optimal estimator (or Kalman filter) has the form 

0 

x(t) = A x(t) + B u(t) + K [z^(t) - H x(t)] 

The estimator gains are given by 

T -1 

K = P H G 

where P is the error covariance matrix 

T 

E [x(t) x(t + t)] = P 6 (t ) 

P is the positive definite solution to the steady - state filter matrix 
Riccati equation 



A P + P A + 1 F 1 -PH G H P = 0 

c.) The optimal control problem generates an optimal control law 
u(t) which is a linear function of the estimated state 

u_(t) = - L x(t) 

where L is a p x n optimal controller gain matrix. The gain matrix L is 
identical to the one obtained by solving the optimal control problem with 
no system disturbance, exact state information, and the index of perfor- 
mance given by 

00 T T 

J = j* [ Z (t) Q y(t) + U (t) R U(t)] dt 

o 

the controller gain matrix L is given by 

-1 T 

L = R B S 
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where S is the positive definite solution to the steady-state control 
matrix Riccati equation 

T T -IT 

"SA-A S-C QC+SBR B S = 0 

It can be shown that the state covariance matrix 
E [x(t) x T (t; + t)T = (P + M) 6 (t) 

where P is the solution to the filter matrix Riccati equation and M is the 
positive definite solution to 

(A - B L) M + M (A - B L) T + K G K T = 0 

In addition to the solutions outlined above, it can be shown that the 
transfer matrix relating the Laplace transform of the optimal control law 
u(t) to the Laplace transform of the measurement vector £(t) (with 
v (t) = C) is given by 

U (S) = - L (SI - A + B L + K H) _1 K Z (S) 

where 

U(s) = i [u (t)l 

Z (S) =••• J[z (t)l 

In addition, the characteristic roots of the estimator are the roots of 

| S I - (A - K H) |=0 

and the characteristic roots of the state -feedback controller are the roots 
of 

|SI-(A-BL)|=0 

The characteristic roots of the entire closed-loop system, i.e., the plant, 
estimator and state -feedback controller are just the estimator roots and 
state feedback controller roots taken together. 
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II. OSPAC Description 



A. Introduction 

OSPAC makes extensive use of the Variable Dimension Automatic Synthesis 
Program (VASP) configured by John s. White and Homer Q. Lee of NASA Ames 
Research Center. A documentation report entitled "Users Manual for the 
Variable Dimension Automatic Synthesis Program (VASP)," Oct. 1971 } may be 
obtained from NTIS (N72-10190). OSPAC can provide the following output: 

1. ) S, the solution to the steady-state control matrix Riccati 
equation. 

2. ) L, the controller gain matrix. 

3. ) P, the solution to the steady-state filter matrix Riccati equation. 

4. ) K, the estimator (filter) gain matrix 

5. ) P + M, the covariance of the system state 

6. ) CVHX , the covariance of H x(t) 

7. ) CVU , the covariance of u(t) 

8. ) J, the value of the index of performance 

9. ) the roots of 

| S I - (A - B L) J = 0 
| S I - (A - K H) | = 0 

10.) the elements of the transfer matrix relating U(S) to_z(S) 

OSPAC solves the steady-state Riccati equations by integrating the 
differential Riccati equations until a steady-state solution is reached or 
when the maximum number of integration steps (as specified by the user, see 
NC0NT(2) below) has been reached. 
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B. OSPAC Input 

As presently configured, the maximum dimensions of the input matrices 
for OSPAC are 

n - 10 

p = 10 

q = 10 

t = 9 
u = 9 

It is imperative that, in his program, the user ensure 

q < n 
t < n 
u < n 

If the conditions above are not met, subroutine AUG will produce incorrect 
results . 

The input card arrangement is shown in tabular form on the next page. 

The description of the items in the table follows. 

NSOL This single integer , in format (II) specifies the number of problems 
to be run. 

NOPT This single integer, in format (II) specifies the solution option. If 

NOPT = 1, one obtains only the state -feedback controller solution (L, S ) . 

NOPT = 2, one obtains only the estimator or filter solution (K, p) . 

NOPT = 3, one obtains the controller, estimator and covariance solutions 
(L, S, K, P, P + M, CVHX , CVU , j) . 

NOPT =4, one obtains the same solutions as in NOPT = 3 plus the system 
characteristic roots and transfer matrix. 
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OSPAC Input Cards 
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NCONT 



This vector of length 3 is input for each Riccati solution (S, P 
and M) in format (3H0) 

NCONT (1) = 1 

NCONT (2) = maximum number of integration steps in Riccati solution; 

NC0NT(2) should be ;> 100. 

NCONT (3) = 1 

A, B, etc. With the exception of NCONT, each input matrix requires a 
header card in format (a4, 4x, 214) . This represents a 4 
character title, 4 blank spaces, then the number of rows and 
columns in the matrix. Each row, beginning on a new card is 
entered after the header card. Since the program can handle 
some 10 X 10 matrices and since the input format is (7E10.5), 
some matrices may require 2 cards per row. However, each 
matrix row must begin on a new card . 

C. OSPAC Output 

The following problems may occur in some OSPAC executions. 

1. ) UNDERFLOW Messages; the VASP programs used in OSPAC frequently 
generate very small numbers which result in UNDERFLOW error messages. The 
main program includes an ERRSET subroutine which prevents the messages from 
being printed each time such an "error" occurs. These underflows do not 
compromise the solution in any way. 

2. ) OVERFLOW Messages; If OSPAC generates OVERFLOW error messages 
which are not attributable to user input errors, then input scaling is 
necessary. This is discussed in Section III 
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3.) Failure to converge; Each Riccati solution, S, P and M, is 
preceded by a statement indicating the number of iterations required to 
obtain the solution. If this number equals the value of NC0NT(2) for that 
equation, then the solution has not converged. Assuming that the system 
is controllable and observable, and that NC0NT(2) £ 100, failure to con- 
verge usually means that the integration step size is too large. The VASP 
routines are supposed to automatically adjust the initial stepsize (set 
equal to 1.0D+00 in the third argument of the subroutines ETPHI called 
in the main program) for each problem. Occasionally, however, this auto- 
matic procedure fails. The user should then reduce the value of the 
constant in the ETPHI call statement for the particular equation (controller, 
filter, or state covariance) which failed to converge, and rerun the job. 

The appendix provides a listing of the main program and all the 
subroutines . 



For large systems (n ^ 8), some scaling of the input matrices is 
often necessary. When OSPAC produces overflow error messages and no ob- 
vious source for these errors can be found, scaling is indicated. A 
simple scaling procedure that has been used with a good deal of success 
with OSPAC involves amplitude scaling the system equations as though 
they were going to be programmed on an analog computer. Again consider 
the system 



III. Scaling Considerations 



x (t) = A x(t) + B \a(t) + ^ w(t) 
jr (t) = C x(t) 
z (t) = H x(t) + v(t) 




T _ » o 
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Now define the following matrices: 

X, , is an n x n diagonal matrix whose elements, x , are "guestimates" 

-M mu 

of the maximum values of the state variables x^(t). 

U„ 'is a p x p diagonal matrix whose elements, u w , are ’’guestimates" of 
— M M. . 

11 

the the maximum values of the controls u^(t). 

Y, . is a q x q diagonal matrix whose elements, y w , are "guestimates" of 

— M M. . 

11 

the maximum values of the output variables y\ (t) . 



Z w is a u x u diagonal matrix whose elements, z w , are guestimates of 
— M M. . 

11 

the maximum values of the measurements z.(t). 

l 



Now define 



£,(*> - 


5 1 act) 


2.<*> - 




z,rt) - 




^(t) = 





where the subscript 's' refers to scaled quantities. Rewriting the original 
system equations using the matrices defined above yields 



=ifM2s (t) + ^ U M U s (t) + 12^ 

=M=Sl=yt) + X(t) 

J ’ ““ f / ^ (t) ’ T a Pj, yjt)i r 

C U M u s (*)]) dt 
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These equations can be written 



x s (t) = A g x g (t) + B g u g (t) + y s w(t) 



y s (t) = °s x s (t) 



*,(t) - H s x s (t) + u s (t) 



with 



J « lim ^ J* [y s T (t) Qg y s ( t ) + u s T (t) R u s (t)] dt 

T -* oo o — — • — — 



F = F 

s — 

G = Z" 1 G Z J 1 
s M — M 



where 



A = 



-1 



Xm AX 



M 



B = 



a u m 



C = 



Y n 2 . 



v„ = 



X M ly 



H = 



C a X M 



Q„ = 



y m T a y m 



R = 



u h T a U M 
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